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Generalization of the minority game to more than one market is considered. At each 
time step every agent chooses one of its strategies and acts on the market related to 
this strategy. If the payoff function allows for strong fluctuation of utility then mar- 
ket occupancies become inhomogeneous with preference given to this market where the 
fluctuation occured first. There exists a critical size of agent population above which 
agents on bigger market behave collectively. In this regime there always exists a history 
1 of decisions for which all agents on a bigger market react identically. 

o 
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1. Introduction 

Minority game (MG) is a model of adaptive behavior in multi-agent systems where 
being in minority is profitable [1] . Each agent can individually adapt to variable state 
of the system by updating its choice algorithms, called strategies. This adaptation 
can be done using data from the sequence of recent winning decisions. Strategies 
are ranked every time by evaluating their utilities, dependent on the integrated 
population actions, such that the best strategy can be chosen. 

The MG was originally formulated [21 [3] for one public sequence /i of winning 
minority decisions. There was also one binary choice set, available for each agent, 
and actions were defined on the same set of events. Overall demand, being a sum 
of individual actions, was calculated for the whole set of agents. Using analogy to 
bargain on a stock exchange, where actions are interpreted as sell or buy^ we call 
such game a single-market minority game (SMG). 

Observing real financial markets one immediately finds that large numbers of 
investors use to act concurrently on many markets, usually different in size, decid- 
ing not only on their sell/buy actions but, first of all, choosing the market. This 
naturally motivates to generalize the original minority game in order to account 
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Fig. 1. Representation of MMG where each agent (black point) is linked to the market (white 
point) where it acts. 

for such multi-market agent activity and call it the multi-market minority game 
(MMG). The MMG can be visualized as in Fig.[Tl where the open symbols refer to 
markets, the black ones to agents and link between an agent and a market repre- 
sents enablement of the agent to play on this market. If the agent actually acts on 
the market the corresponding link is called active. 

In this paper, among other things, we are particularly interested in distribution 
of market occupancies and its time evolution. In many network systems it is observed 
[TO] that a small number of nodes absorbs majority of active links. We can see the 
similar phenomenon in the MMG where significant differences between numbers of 
agents acting on different markets arise in course of the game. Further in the paper 
we call this phenomenon the breakdown of the symmetry of choice. 

2. Formal definition of the game 

The MMG consists of N agents and K markets. At each time step t, the n-th agent 
{n = 1, . . . , N) chooses a preferable market fc„(f) G {1, . . . , K} and takes action 
a„ {t) G {—1,1} on this market. For each market k an aggregated demand is defined 



where Nk{t) is the number of agents who chose market k at time t. The Ak{t) is 
thus the difference between numbers of agents who choose the -|-1 and —1 actions. 
Agents do not know each other's actions but Ak{t) is known to all agents on the 
market. For each market k the minority action is determined 




(1) 



n=l 
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sgn Ak{t). 



(2) 



Each agent's memory is limited to m most recent winning decisions. 



June 20, 2009 12:41 



Multi-market minority game: breaking the symmetry of choice 3 

Each agent has the same number s > 2 of devices, called strategies, per market, 
altogether K -s strategies per agent. Strategies are used to predict the next minority 
action a^(i + 1). The strategy of the n-th agent, a„, is a function mapping the 
sequence of last m winning decisions to this agent's action a„. Since for each 
market there is P = 2™ possible realizations of fik, there is 2^ possible strategies 
per market. At the beginning of the game each agent randomly draws s strategies for 
each of K markets, according to a given distribution function p{n, k) : NxK ^ Aj^, 
where Aj^ is a set consisting of s strategies. For clarity, we give the flow chart of the 
game in Appendix A, where the processes of generation of the memory pools and 
taking decisions by agents are better illustrated. 

Each strategy a„, belonging to any of sets A^, is given a real- valued function 
Ua„ which quantifies the utility of the strategy: the more preferable strategy, the 
higher utility it has. Strategies with higher utilities are more likely chosen by agents. 

There are various choice policies. In the popular greedy policy each agent selects 
the strategy of the highest utility 

a„(t) = arg max Ua„{t). (3) 

Q„e{A,\,...,A;;} 

The strategy ^ used by the agent is called the active strategy, in contrast to passive 
strategies unused at given moment. At given time an agent acts only on one market 
related to the active strategy. However, every time it evaluates all its strategies, 
active and passive ones. Each strategy a„ is given the payoff related to its action 

i?a„(0 = -aa„W.9[A(t)], (4) 

where g is an odd function, e.g. g{x) = sgn(a;) [3]. Other choices are g{x) = x/N or 
g{x) = X, the latter used in the present work. The learning process corresponds to 
updating the utility for each strategy 

Uc^At + = UaAt) + RcAt) (5) 

such that each agent knows how good its strategies are. 
3. Network structure 

We distinguish two types of markets: the regular where all N agents can choose 
any market, and irregular one where Ni agents can play only on one market and 
remaining N2 = N — Ni agents can choose both (cf. Fig. [2]). 

At any time, agents connected to more than one market have to choose only 
one of them to act. Sets of strategies for markets and lengths of memories m do not 
change during the game. These two network structures are sufficient to demonstrate 
the phenomenon of the asymmetry of choice and its universality. In particular, we 
observe that the phenomenon does not depend on the structure and is present for 
both topologies. Irregular topology is more general and better reflects reality where 
numbers of agents playing on different markets may not be the same. 
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Fig. 2. The regular (left) and irregular (right) market structures. Full lines correspond to agent 
(black points) links to the first market (white points) and dashed ones to the second market. 

In this paper the MMG on two markets is studied in detail but we discuss also 
briefly the three-market case. 

4. Relation to other models 

The MMG was first discussed by the authors of ref. [4j and developed subsequently 
[S] . The authors study in detail the rules used by each agent when switching between 
markets, and how the agent's performance depends on these rules. Performance of 
agents is measured by the volatility, i.e. the variance of the aggregate demand nor- 
malized to the number of agents, for various schemes. It is found that the volatilities 
qualitatively behave similarly for all considered schemes. However, the overall levels 
of volatility differ for different switching schemes. In particular, the volatility in the 
virtual scores scheme where the highest-utility strategy is chosen, is relatively higher 
than in the other schemes in the cooperation mode . This switching scheme was 
used in the present paper. Summarizing, our model coincides with the model of ref. 
[S] with the virtual scores scheme. They exhibit the following features: 

(1) Individuals can choose a market from a set of markets of different size. 

(2) Each agent has at least two strategies per market. 

(3) The choice of the market and the action on it are preceded by the analysis of 
the self-generated information pattern ^. 

(4) The strategy space is not reduced. 

As a result, such MMG represents a direct extension to the classical MG. It is 
important to notice that the analysis in ref. [5] was performed in the cooperation 
regime of the game. Therefore the authors could not observe the phenomenon of 
breaking the symmetry of choice which shows up in the herd regime and is found 
and explained in our research, as described below. 

Other known extentions to the classical MG formulate the multi-choice [7] or the 
multi-asset MGs with one [5] or more [5] strategies per asset. The authors of ref. [5] 
also observe the breakdown of the symmetry of choice but using different kind of 
model. They assume that public information pattern fi is chosen randomly and 
independently, and with uniform probability, from the artificially created pool of 
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information patterns for each asset. A distinct feature of that MMG is an artificiaUy 
introduced asymmetry of sizes of pt pools for each asset. This means that their MMG 
cannot use the history of the real past winning decisions because in such a case 
one could generate a history not included in the reduced pool. Consequently, the 
history ^ has to be chosen randomly from the reduced sets for each asset and for each 
time step. The dynamical character of the game is then limited only to the strategy 
score. In our opinion, this change distracts the model from the original idea of the 
MG, whereas our model is a more straightforward extension of the genuine MG. 
This modification, viz. the artificial asymmetry of the pools, is responsible for the 
market split observed in ref. [8] . Therefore the symmetry breaking observed in ref . 
[8] is not a spontaneous one, contrary to our model where the sizes of information 
pools are equal. To be more specific, we recall the notation used by the authors of 
ref. [8] who define two memory pools fi± and ratios a± of their sizes to the number 
of agents 

/i± e {1,...,P±}, 

a± = P±/N, (6) 

where P± stand for sizes of these pools. These sizes are not necessarily maximal, i.e. 
they may be smaller than 2™. This naturally limits the choice set and violates the 
symmetry of choice in case q;+ ^ a_ just because of unequal sizes of /i+ and fj,-. 
Contrary to that, in our model there is always = and fi± are maximal, i.e. 
P+ = P_ = 2™. In this case the authors of ref. [5] do not observe any asymmetry 
but wc do. Our present paper aims to explain why in certain circumstances markets 
behave asymmetrically despite a_|_ = q_. 

5. Asymmetry of choice 
5.1. Regular markets 

After performing numerical simulation for the regular markets we plot the fcth 
market occupancy Ok{t), defined as the number of agents acting on this market at 
given time, and the fcth market demand Ak{t), for three total agent populations 
iV = 11, 253 and 1447 (cf. Figs [3] and H . 

These numbers correspond to different modes of the game: the random {N =11 
and m = 5) and the herd {N — 253, 1447 and m = 5), according to the terminology 
used in ref. [6] for the SMG. Comparing behavior of Ok{t) for different populations 
one observes that for large N most agents prefer the same market to act (we call 
this market big) and one sees that Ofe(t) tends to stabilize fast. There is no such 
effect for small N. These observations are robust with respect to small variations 
of N. Simulating ensemble of histories we checked that both markets are equally 
likely to become big. Another effect, seen only on a big market, is an appearance of 
distinct peaks of Ak{t) (Fig. 21 right), comparable in size with the values of Ok{t) 
for big market. 



20, 2009 12:41 



6 K. Wawrzyniak and W. Wislicki 




200 400 600 800 1000 

t 



Fig. 3. Time evolution of the market occupancy Ok{t) (black lines correspond to fc = 1 and grey 
ones to A: = 2) in MMG for m = 5 and for three agent populations = 11 (upper left), 253 (upper 
right) and 1447 (bottom). It is seen how the split of the market occupancies increases with A'^. 

In order to study the effect further, consider the following regular game with 
large N: 

(1) For any given history /i of winning strategies, about half of strategies a suggest 
action a = 1 and another half a = — 1, 

(2) Utilities of strategies are uniformly distributed at initial time. 

For such defined MMG we perform 300 steps of evolution and in Fig. [5] we plot 
Ok{t), Ak{t) and the number of agents who change the market C{t). Fig. [6] presents 
utility evolution for three agents, each of them using two different strategies on two 
markets. 

Depending on the sign of the payoff ^ associated with the minority decision ([2]), 
the strategy is called good {had) for the positive (negative) payoff. The probability 
of the output of any strategy on the fc-th market is the same as for the minority 
decision on the A:-th market and is equal to 1/2. Thus the probability that an agent 
has no good strategies is equal to 1/2^*. Subsequently, the probability of having at 
least one good strategy is equal to 1 — 1/2*. For example, for s = 2 the 75 % of the 
population, in the limit iV — > oo, has at least one good strategy on market 1. 

Since the Ak{t) fluctuates [IIII], in both the SMG and MMG, rapid change is 
also observed in the utility U{t), according to eqs (g]) and ([5]). If Ak{ti) strongly 
fluctuates at time ii, the utility of strategies related to market k is strongly affected. 
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Fig. 4. Time evolution of the market demand Ai^(t) (black lines correspond to fc = 1 and grey ones 
to A; = 2) in the MMG for m = 5 and for three agent populations N = 11 (upper left), 253 (upper 
right) and 1447 (bottom). It is seen how the fluctuations of A2{t) become more distinct for large 
N. 



This can be seen in Fig. [5] where at t = 7 high value of A2 shows up for the first time. 
Consequently, utilities of strategies on market 2 change proportionally to ^2(7), as 
seen in Figs[6l At ti + 1, about 1 — 1/2* of agents have at least one strategy with 
high U{ti + 1) on the market where the fluctuation of A occured first. All these 
agents choose this market. As seen in Fig. [H at < = 8 about 75% of the population 
has at least one strategy with high utility on market 2. Only agents with two bad 
strategies stay with market 1. 

Since large fluctuation Ak{ti) comes after some history fi'^ = fik{ti), all agents 
which have at least one strategy suggesting the same output as the minority action 
a^(ii) for this history tend to choose the bigger market in the next step. The 
has a non- vanishing probability to reappear at ^2 > ^i- Consequently, all agents 
belonging to bigger market react on the same way and Ak(t2) for this market 
deviates maximally, i.e. ^^(^2) = Ok{t2), and no agent on the big market belongs to 
the minority. In Fig.O the ^§ appears again at t = 47 and ^2(47) = 02(47) ~ 1200. 

At t2, all strategies with high U{t2) on bigger market fail and get penalty 
—Ak{t2), whereas strategies with low U{t2) are rewarded with Ak{t2)- As seen 
in Figs [HI a quarter of the population with two high-utility strategies on bigger 
market now has two strategies with low utility. This part decides to change the 
market. Another quarter of the population with two low- utility strategies now has 
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Fig. 5. Time evolution of the market occupancy Ofc(t) (upper left), aggregated demand Afc(t) 
(upper right) (black lines correspond to fc = 1 and grey ones to fc = 2) and number of agents 
changing prefered market C{t) (bottom) in the MMG with TV = 1600, s = 2 and m = 5. 



two strategies with high U{t) and switches from the smaller market to the bigger 
one. Remaining half of the population has one low- and one high-utility strategy. 
This group remains in the similar situation and stays on a bigger market, although 
the utilities of strategies are swapped. Generally, when /i^?' appears then about half 
of agents changes market but Ok{t) remains constant. 

Another important characteristics of fluctuation dynamics is given by the fluc- 
tuation frequency. In the asymptotic regime, the frequency of large fluctuations of 
Ak on bigger market is equal to 

(iy)-l/2™, for iV^oo. (7) 

Each history appears, on average, once per 2™ times and a large fluctuation of 
Ak occurs always after the history fi^ . We checked numerically that simulated 
(u) converges to the asymptotic value ([7]) when simulation time and N become 
large. We also checked that, indeed, simulated histories /i are distributed uniformly 
with probabilities p{fj,) around 1/2™ = 1/32 (m = 5), as seen in Figs [7] (upper). 
Contrary to that, for small N some histories may be significantly more frequent 
than the others, as seen in Figs [7] (lower). In such a case, the pool of strategies for 
the whole population is not large enough, their choice space is restricted and some 
histories occur more often. Similar inhomogeneity of p{p-) was observed in case of 
the SMG, in somewhat different representation, by the authors of ref. [B]. 

Interesting is the dynamics of the MMG when approaching its stationary regime. 
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Fig. 6. Time evolution of the utility for 4 strategies, for the MMG with TV = 1600, s = 2 and 
m = 5, for three representative agents: with two high-utility strategies on market 1 at the time 
ti + 1 = 8 (upper left), one high- and one low-utility strategy on market 1 at the time ii + 1 = 8 
(upper right) and two low-utility strategies on market 1 at ti + 1 = 8 (bottom). Grey lines, thin 
and bold, correspond to 2 strategies on market 1 and black ones, thin and bold, on market 2. 



In order to illustrate this, we examined the relaxation time of market occupancies. 
As seen in Fig. [3] (right), for large population the stationarity of the Ok{t) at levels 
N/2'' and A^(l — 1/2'*) is reached after finite time. This time is related to the first 
occurence of strong fluctuation of Ak{t), as discussed. Defining tq as the time when 
Ofc(<) enters the ±5% belt around N/2'' or A^(l — 1/2'*) and stays inside it forever, 
we present in Fig. [8] how tq depends on the often used variable Q = N/2"^, where 
m = 5. Decreasing ro(-/V/2™) is consistent with our observation that for large agent 
population the probability of strong fluctuation of demand is more likely. Note 
however that tq is meaningless for too small N when market occupancies do not 
stabilize at their asymptotic levels. 

Another interesting feature of the MMG is seen when the asymmetry of choice 
is examined as a function of an overall population size N . Figs [9] show dependence 
of the mean occupancies and demand variances per capita on Q = N/2"\ This 
dependence is shown separately for the big and small markets. At Qc — 8 the 
qualitative change of behaviour is observed. Below Qc both markets are about 
equally populated and have similar variance of A^, whereas above Qc one of the 
markets becomes visibly bigger and has larger variance. Below Qc the population is 
too small to generate fluctuation in Ak sufficient to significantly affect utilities and 
split the agent set into two unequal groups. Our per capita demand fluctuations 
{AD /{Ok) calculated for the MMG differ from that in the SMG where the quantity 
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Fig. 7. Probability density p{fJ.) for simulated histories fi for MMG with = 1447 and m = 5, 
for the small (upper left) and large (upper right) markets, and the same probabilities for A'^ = 11, 
for the small (lower left) and large (lower right) markets. The p(/i) was estimated from 5,000 time 
steps for each game. 
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JV/2" 



Fig. 8. Relaxation time ro of the market occupancy Ok{t) versus for m 

mean from ten games and error bars correspond to one standard deviation. 



5. The TO is a 



{A^)/N is considered. Our definition of the MMG assures that simphfying MMG 
to SMG, which is tantamount to switching to the classical MG, one gets identical 
games. 

The SMG is known to exhibit three modes of behavior: the random, cooperation 
and herd [6 . In the MMG, in addition, the fourth mode can be identified. We call 
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Fig. 9. Mean occupancies of markets (O) (left) and variances of per capita demands (A'^)/{0) 
(right) as functions of Q = JV/2™, where m = 5 and N is variable. Solid lines correspond to the 
small market and dotted lines to the big maxket. The markets have regular structure. Error bars 
correspond to one standard deviation and curves are drawn to guide ones eye. 




Fig. 10. Mean occupancies of markets (O) (left) and variances of per capita demands {A^) / (O) 
(right) as functions of Q = for variable A^i, fixed N2 = 301 and m = 5. Solid lines 

correspond to market 1 and dotted lines to market 2. The markets have irregular structure. Error 
bars correspond to one standard deviation and curves are drawn to guide ones eye. 



this behaviour herd asymmetric, to be distinguished from the herd symmetric where 
no market spht is observed. In this terminology the values of Q G {0.34, 7.9,45.2} 
chosen for our simulations correspond to the random, herd symmetric and herd 
asymmetric modes. Asymmetry appears at the transition point Qc where fluctua- 
tions per capita for the small market become lower than for the big market. Using 
economic terminology, the small market becomes more efficient than the big one. 

We also checked if the asymmetry is present for more than two markets of regular 
structure. Considerations similar to discussions of Figs [31 2] and E] lead us to the 
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asymptotic theoretical formulae for market occupancies. If we order K markets, 
beginning from the biggest one, we have 

ri-1/2", k = l 

{Ok) =n\{1- 1/2^)(1/2^)'=-i, l<k<K (8) 
[(l/2'')^-i. k^K 

We verified this result by simulations for three markets (K = 3) and present market 
demands and occupancies in Figs [11] Similarly to the K = 2 case, the occupancies 




°0 500 1000 1500 2000 °0 500 1000 1500 2000 
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Fig. 11. Time evolution of market demands Afe(t) (left) and occupancies Oh(t) (right) for three 
regular markets with N = 3001, s = 2 and m = 5. The lightest grey curves correspond to the 
largest market occupantion with the largest demand fluctuations. 

stabilize and the largest occupancy corresponds to the market with the largest 
demand fluctuations. 

5.2. Irregular markets 

Consider irregular markets with variable A^i and fixed N2 — 301. One expects that 
increasing iVi amplifies the probability of high Ai{t) and expects significant increase 
of utilities for all strategies on the first market. Further reasoning follows that, for 
the regular MMG, high Ai{t) has no impact on the market preference of agents 
playing on market 1 but seriously affects those on market 2. The mean presence on 
market 1 grows indefinitely and is asymptotically linear with Ni 

(Oi) - TVi + (1 - 1/2'')7V2 for Ni 00. (9) 

For the mean presence on market 2 there exists the limit 

lim (O2) = N2/2\ (10) 

Fig. [TO] presents simulations for mean occupancies and demand variances as func- 
tions of Q = iVi/2™. As seen in Fig. [TO] when the market 1 grows then the market 2 
becomes more efficient. This is understandable because if N2 agents were separated 
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then such market would work in the herd mode [6] . Allowing agents to act also on 
market 1 spurs some of them to do that. The larger A'^i, the bigger fraction of A^2 
prefers market 1 and the smaller fraction of A'2 prefers market 2. Consequently, 
(O2) converges to the limit (|10|) . equal to 75 for our simulation. Decreasing N2 
makes smooth transition of market 2 from the herd mode to the cooperation mode, 
reflected in lower per capita fluctuations (cf. Fig. llOp . 

6. Conclusions and final remarks 

We considered the MMG as a natural generalization of the classical MG. Although 
each agent has a priori the same probability to play on all markets, after some 
time most of them act on this market where relatively high aggregated demand 
occurs for the first time. This spontaneous breakdown of choice symmetry depends 
on the payoff function g in eqn In particular, for g{x) = x strong fluctuation of 
demand significantly affects utilities and the effect is well visible. We checked that 
for weaker g{x) the effect if less pronounced and for g{x) = sgn(a;) it disappears. 
This corroborates our conjecture that in the MMG there may exist markets strongly 
attracting clients. How fast it occurs, it depends on the likelihood of strong demand 
fluctuation. This reminds the well-known phenomenon on the scale-free networks 
where links are absorbed by nodes very inhomogenously and the initial random 
inhomogeneity of absorptive power of nodes determines their further imparity in 
course of the evolution. This kind of behaviour can be also observed on real financial 
markets. Large markets of high liquidity strongly attract agents because they enable 
easy conversion of chunks of assets into cash. This constitutes a feedback mechanism 
making these markets even more liquid, etc. 

In our model of the MMG we pointed out that the effect of symmetry breaking 
is visible only for s > 2. However, the mathematical formalism introduced in the 
paper is true also for s = 1. As we mentioned in chapter 5, the market occupancies 
Ok{t) stabilize at the levels A^/2* and N{1 — 1/2*). Therefore the occupancies are 
equal for s — 1 and the effect cannot be observed. This explains why the authors of 
ref. [8], using s = 1, did not observe any symmetry breaking in their model. 

We found that in the MMG there exists a critical value of 7V/2™ above which 
agents behave asymmetrically. In this mode we observe collectivity in their be- 
haviour. In particular, there always exists a history /i^? for which all agents on big- 
ger market react identically. We are aware of similarities of the asymmetric mode to 
some mechanisms on real financial markets. The closest real analogy is perhaps fi- 
nancial crisis when majority of investors sell an asset. However, there are important 
shortcomings of our model with respect to reality, e.g. restriction of coUcctiveness 
to given history /i^. In addition, in reality individuals usually do not continue 
their game just after selling an asset but may stay apart for some time. There- 
fore adequacy of our MMG to real markets is still limited. We see some promising 
extensions of the classical MG which could improve the MMG. Among them are 
the grand canonical approach [T^], stochastic strategies [13] and categorization of 
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investors [l4] . 

Appendix A. The flow chart of the multi-market minority game 
simulation 
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Fig. 12. The diagram of the MMG simulation for A'^ agents and m = 2 decision record length, 
K = 2 markets and s = 2 decisions for each agent and each market. 



The diagram in Fig. [12] presents how the MMG is simulated. At any time step 
t each of N agents examines the pubhc pattern ^k{t) of m most recent winning 
decisions on each of K accessible markets (fc = 1,...,K, where if = 2 in our 
example in Fig. [T2|l . Each agent acts according to its policy encoded in s strategies 
per market (s = 2 in Fig. [T^ . First, an agent chooses a strategy and then acts on 
the market assigned to this strategy. At any time one agent acts on one market 
only. Subsequently, the aggregate demand Ak{t) and the minority action a^(i) on 
the k-th market are calculated according to the minority rule. The Ak{t) constitutes 
a feedback to agents, used by them in the adaptation process. The al{t) is then 
concatenated with fik{t) thus producing ^^(i+l). The patterns /ifc(t+l) are analysed 
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by agents at t + 1. 
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